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Image-information storage regenerating device 



(54) 

(57) The present invention provides such a data 
storing format that is effective for solving problems 
which may arise when regenerating video data in a 
video data storage and communication system. A chan- 
nel data separating portion (91) splits a multiplexed 
input into audio/video and other components. An error 
correction portion (92) corrects an error of the video 
data outputted from the channel data demultiplexing 
portion (91). A video frame extracting portion (93) 



extracts a video frame outputted from the error correc- 
tion portion (92). A packet assembling portion (94) 
assembles a packet from the video data outputted from 
the video frame extracting portion (93) and the audio 
data outputted from the data demultiplexing portion 
(91). A storage portion stores therein the packet output- 
ted from the packet assembling portion (94). Conse- 
quently, video data can be stored by video frames. 
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® The present invention provides such a data stor- 
ing format that is effective for solving problems 
which may arise when regenerating video data in a 
video data storage and communication system. A 
channel data separating portion (91) splits a mul- 
tiplexed input into audio/video and other compo- 
nents. An error correction portion (92) corrects an 
error of the video data outputted from the channel 
data demultiplexing portion (91). A video frame ex- 



tracting portion (93) extracts a video frame outputted 
from the error correction portion (92). A packet as- 
sembling portion (94) assembles a packet from the 
video data outputted from the video frame extracting 
portion (93) and the audio data outputted from the 
data demultiplexing portion (91). A storage portion 
stores therein the packet outputted from the packet 
assembling portion (94). Consequently, video data 
can be stored by video frames. 
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BACKGROUND OF THE INVENTION 

The present invention relates to a image-in- 
formation storage regenerating device, and more 
particularly to a video communication system 
which can collect and store multiplexed data of 
audio/video and other information from video data 
communication terminals (e.g., visual telephone 
sets) according to the recommendation by ITU 
(International Telecommunication Union) and allows 
users to regenerate the stored data through their 
terminal sets, and more particularly to a video data 
storage control device for regenerating a video data 
file stored in a storing/regenerating center (storage 
device) for video data, and more particularly to a 
video data regeneration control device which is 
capable of transmitting stored coded video data 
from a video data storage and regeneration center 
(storage device) to an audio-visual(AV) terminal and 
enabling the terminal to decode the received coded 
video data and reproduce images thereat, and 
which is also capable of transmitting stored in itself 
coded video data to a receiving terminal and en- 
abling the terminal to decode the received coded 
video data and reproduce therefrom the video data. 

Recently, besides conventional interactive 
communication services using telephones and fac- 
similes, such a communication service has been 
provided that audio data stored at a center of 
communication network can be always regenerated 
through users' terminal sets. On the other hand, 
with improvement and development of digital com- 
munications networks, e.g., ISDN (Integrated Ser- 
vices Digital Network), it has been possible to use 
video communication services, e.g. , visual tele- 
phone service. On such background, there is an 
increasing demand for video delivery services us- 
ing a database of video information. Such commu- 
nication services have been locally realized for 
practical use. 

Recently, with improvement and development 
of digital transmission channels and advancement 
of image processing technique, it has been ex- 
pected to develop a method allowing one to effec- 
tively use image-information services over high- 
speed digital transmission networks, a representa- 
tive of which is ISDN (Integrated Services Digital 
Network), by applying advanced high-speed digital- 
signal processing and related LSI technology. Re- 
presentative image communication services such 
as visual telephone services and video conference 
services have been already realized and practically 
utilized. Lately, such an information delivery service 
for supplying information to many unspecified us- 
ers at unspecified time has been expected to ap- 
pear in practice as a new business. 

To supply information to many unspecified us- 
ers, it is necessary to store information in a storage 



(recording device), e.g., a host center, and to pro- 
vide a control system for regenerating information 
at the many unspecified audio-visual terminals and 
storing information from the audio-visual terminals 
5 into the storage. This system is represented, for 
example, by an image-information regeneration 
control device that controls regeneration of image- 
information from the host center to the audio-visual 
terminals. 

to In a conventional image-information regenera- 

tion control device, coded image-information is 
stored with screen (frame) numbers and is trans- 
mitted with the same screen (frame) numbers to an 
audio-visual terminal at which the coded image- 
75 information is then decoded and regenerated ac- 
cording to the screen numbers. 

The image-information communication service 
may often transmit a interactive-mode screen (e.g., 
a service menu or guidance for user) and coded 
20 data of different object images in succession to a 
user terminal and continuously regenerate them at 
the terminal. 

In a conventional image-information transfer 
system, a center control unit negotiates with a 
25 terminal as to decoding capability of the terminal 
before transmitting coded image-information there- 
to and, only in case of the terminal having a 
sufficient decoding capaility, it reads and transmits 
the coded image-information stored together with 
30 their screen (frame) numbers to the terminal. 

Japanese laid-open patent publication No. 62- 
188579 describes a stored video data regenerating 
device for use in a packet communication network 
for transmitting moving picture information from a 
35 moving picture database, which converts video 
data into video signals adapted to be easily re- 
ceived by user's terminal sets by absorbing vari- 
ations of delay in transmission of packets over the 
packet communications network and allows user to 
40 get desired video information from the data base at 
any desired time. 

Japanese laid-open patent publication No. 3- 
132128 describes a stored video data regenerating 
device that allows for storing messages of video 
45 and audio data composed of still-pictures and re- 
corded pictures inputted from users through their 
terminal devices and allows each user to reproduce 
a massage corresponding to his request on a dis- 
play screen of his terminal, 
so Japanese laid-open patent publication No. 4- 

79655 describes a stored video data regenerating 
device that has means to register conditions of 
collecting information from a user's terminal having 
functions for inputting and outputting video/audio 
55 and characters, and that calls the terminal accord- 
ing to the registered information and automatically 
receives information and stores the collected in- 
formation as requested by a client. 
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As a conventional stored image regenerating 
device may be designated a device that is de- 
scribed in a reference paper titled "Prototyping of 
PC-Videophone with Built-in Codec based on Open 
Architecture" (by Ichizo KIMURA and 7 et al.), the 
journal of the Institute of Image Electronics En- 
gineers of Japan, 1993, Vol.22, No. 4, pp. 355 - 
367. 

The above-mentioned reference describes how 
to store and regenerate audio/video data, indicating 
two possible methods: the first method is directed 
to store the multiplexed audio/video data as un- 
changed and the second method is directed to 
disassemble multiplexed data and store 
audio/video data as separated from each other. 
However, the prior art prefers the first method from 
the view point of easier processing multiplexed 
data at a center device and describes necessary 
functions of this method and how to realize said 
functions. 

The present invention pointed out problems of 
the prior art method of storing audio/video as mul- 
tiplexed data and provides a novel method that 
separates media, particularly video (image-informa- 
tion), and stores them as separated from each 
other in order to solve the problems involved in the 
prior art. Furthermore, the present invention dis- 
closes that an excellent video communication sys- 
tem can be constructed by applying therein several 
new techniques. Practically, the data storage and 
regenerating device according to the present invent 
ion is featured by new functions such as data 
management by frames, synchronizing by time 
stamps and adjustment of information amount by 
inserting fill bits, and which realizes, thereby, so 
flexible and so high leveled functions that can not 
be attained by the prior art multiplexed data storing 
system. 

Accordingly, it may be clearly understood that 
the present invention in its basic conception quite 
differs from the prior art, and it also discloses novel 
and useful art to solve the problems of the prior art. 

As described above, the conventional system 
stores data as multiplexed by the method adopted 
as an international standard. The data display at 
the terminal device is, therefore, conducted usually 
after synchronization of a FEC-frame (forward error 
correction frame) is established. Namely, image 
can not immediately be displayed. The initial image 
is not always encoded by intra-frame mode and 
may not be self-contained for decoding. Further- 
more, the terminal may not well reproduce images 
because of occurrence of underflow or overflow of 
its buffer, which may result from that the storing 
buffer condition differs from the regenerating buffer 
condition. 

The video data are stored under the control of 
encoded information amount according to buffer 



condition of a terminal. Conventional method can 
not assure the same condition of buffer of a termi- 
nal device when storing data and when regenerat- 
ing data. Any terminal may encounter overflow or 
5 underflow of its buffer when regenerating stored 
video data. Furthermore, in the conventional video 
regenerating device, such a problem may arise that 
stored video data can not be regenerated at a 
terminal if the channel transmission rate to which 

w the terminal is adapted is not compatible with the 
channel rate at which the data were stored. For 
instance, said problem may occur when video data 
stored by a terminal adapted only to a channel rate 
of B using a basic interface of ISDN is regenerated 

75 at a terminal adapted only to a channel rate of 2B. 

In video data storing, a transmitting AV-terminal 
according to the recommendation H.261 encodes 
successive objective frames by motion compen- 
sative inter-frame prediction and sends the en- 

20 coded video data. When an video datastoring cen- 
ter starts storing operation, coded video data by 
screens, for example, Bo-B n are read-out and 
stored in a storage such as a host machine. In this 
case, the screen Bo is encoded by prediction with 

25 reference to the frame B-i . 

In image reproduction, the coded video data, 
e.g., frames A-3 - Ai and Bo-B n stored subse- 
quently to the screen A-i are successively read 
from the video data storage center by the host 

30 machine and sent to an AV-terminal. These data 
maintain an integrity as successive coded video 
frames and they are, therefore, normally decoded 
at the AV-terminal. 

While the screen Bo is, however, predicted with 

35 reference to the screen B-i at the time of data 
storing (i.e., coding), it will be decoded with refer- 
ence to the screen A-i that relates to a preceding 
object in the order of coded video data. Namely, 
the screen Bo is predicted according to different 

40 screens at coding and decoding. As the result, the 
screen Bo can not normally be reproduced and 
displayed at the AV-terminal. Furthermore, this 
may affect the subsequent screens since screens 
Bi - B n have been dependency coded in succes- 

45 sion by inter-frame prediction. The desplayed 
screen videos may be damaged. 

In the conventional image-information regen- 
eration control device, as described above, a 
screen number (frame number) of video data 

50 (frame data) to be transmitted and received by an 
audio-visual terminal is the same as that of the 
corresponding video data stored in a storage. 
Namely, the stored video data with its unchanged 
screen (frame) number are transmitted to the termi- 

55 nal. For example, when video data are stored in the 
order of screen (frame) numbers "10, 12, 15, 17 
corresponding video data to be transmitted are 
given the same frame numbers "10, 12, 15, 17 ...". 
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Accordingly, when such video data are regenerated 
in succession to a currently displayed image or 
video data of different object, a discrepancy of 
screen numbers may occur at a junction between 
two different image sequences. 

For instance, in case of continuously displaying 
the stored video data in succession to a sequence 
of screen images, jointed screen (frame) numbers 
are described as "screen-image (1), screen-image 
(3), screen-image (5), video data (10), video data 
(12), video data(15) ..." which is transmitted without 
any modification. This causes the audio-visual ter- 
minal to regenerate the received video data in the 
order of their screen (frame) numbers with a dis- 
crepancy of screen (frame) numbers between 
"screen-image (5)" and "video data (10)", i.e., an 
frame interval corresponding to a split of image 
sequences. In this case, video data behind the 
frame interval is regenerated with a delay time. 

As described above, the conventional image- 
information regeneration control device has such a 
drawback that when a screen-image and/or dif- 
ferent kinds of video data are successively trans- 
mitted, discontinuity of screen numbers occurs at a 
junction of the transmitted video data between the 
last screen (frame) of a preceding video data and 
the top screen (frame) of a subsequent video data, 
causing a delay time between the preceding video 
data and the succeeding video data when they are 
regenerated at the terminal. 

The conventional image-information regenera- 
tion control device has to first negotiate with a 
receiving terminal whether the terminal has suffi- 
cient capaility to decode the coded video data 
stored in the device or not. When the decoding 
capability of the terminal is insufficient, i.e., a mini- 
mal frame interval of video data to be decoded by 
the terminal is, for example, 2/29.97 seconds 
(hereinafter described as 2/30 sec.) which is more 
than a frame interval of the coded video data 
stored in a storage of the device, which stores the 
video data encoded at a frame interval 1/29.97 
seconds (hereinafter described as 1/30 sec. ) ac- 
cording to a coding method based upon recom- 
mendation H.261 of ITU (International Telecom- 
munications Union), screen numbers (frame num- 
bers) of the video data(frame data) to be received 
by the terminal must be "0, 2, 4, 6 ..." which differ 
from screen numbers "0, 1, 2, 3 ..." of the stored 
coded video data. Consequently, the center control 
device can not supply the terminal with the coded 
video data as be unchanged. 

The center control device may transmit stored 
video data only by odd number frames (1, 3, 5 ...) 
to get frame numbers "0, 2, 4, 6 ...", but the 
terminal can not correctly regenerate images be- 
cause information of each frame is coded as close- 
ly related with information of precedent and subse- 



quent frames by inter-frame prediction coding. 

As described above, the conventional video 
data regeneration control device involves a prob- 
lem that its center control device can not commu- 

5 nicate with a terminal not having sufficient decod- 
ing capability. 

As described above, the conventional multi- 
plexed data storing and regenerating device sepa- 
rates multiplexed data into audio/video and other 

w information, processes respective data and stores 
or regenerates the data, resulting in arising a dif- 
ferential delay between audio/video data at the time 
of their regeneration. 

75 SUMMARY OF THE INVENTION 

It is an object of the present invention to pro- 
vide an image-information storage regenerating de- 
vice which, unlike the above-mentioned conven- 
20 tional system in which audio/video data are stored 
as multiplexed data, separates the received data 
into audio data and video data, processes and 
stores the video data as video frames (fields) or 
continuous frame (field) having a data format allow- 
25 ing for image processing to solve problems that 
may arise at the time of data regeneration; and 
which is capable of solving the problem "image 
can not immediately be displayed" that may occur 
at regeneration of stored video data; and which is 
30 capable of supervising an amount of information 
and controlling insertion of fill bits to surely prevent 
occurrence of overflow or underflow of a buffer at a 
regenerating terminal; and which is capable of 
matching a data transmission rate of a data send- 
35 ing side at the time of data storing to that of a 
receiving side so that a receiving terminal can 
receives and regenerate stored video data even if a 
channel rate to which the terminal is adapted is not 
compatible with a channel rate at which the video 
40 data were stored. 

It is another object of the present invention to 
provide an image-information storage regenerating 
device by which video data of an initial screen to 
be stored are coded in intra-frame coding mode 
45 (called intra-mode) to obtain video data coded in 
intra-mode (intra-coded screen image) of an initial 
screen that may be correctly reproduced by the 
receiving terminal. 

It is another object of the present invention to 
50 provide an image-information storage regeneration 
device which, in case of reading coded video data 
from a storage device and successively transmit- 
ting different objects video data to a terminal to 
successively regenerate the data thereat, is ca- 
55 pable of previously rewriting a screen (frame) num- 
ber of a top video data just after the end of 
preceding different video data so that the screen 
(frame) number is consecutive with that of the last 
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screen (frame) number of the preceding video data 
to eliminate a delay time of video data due to an 
frame interval, i.e., a discrepancy between screen 
(frame) numbers of two different video data se- 
quences and to successively decode the video 
data, and which, in image storage and delivery 
service using coded video data stored in a center 
control device, is capable of communicating with 
any terminal having a low decoding capability by 
slowly reproducing images thereat. 

It is another object of the present invention to 
provide an image-information storage regenerating 
device which a time stamp to every component 
previous to storing therein the received multiplexed 
data, i.e., audio/video data and, when regenerating 
the multiplexed data, absorbs differential delay of 
different components by using the time stamps so 
that the audio/video signals may not have any 
differential delay in their regeneration. 

Image-information storage regenerating device 
according to the present invention splits a multiplex 
input of audio/video data into separate signals by 
using data demultiplexing portion, corrects an error 
of the video data by error correcting portion based 
upon the method of FEC (forward error correction), 
extracts a video frame by using video frame ex- 
tracting portion, assembles a packet with informa- 
tion on multiplexing rate and encoding method, by 
which audio/video data are stored, by using packet 
assembling portion, and stores thus prepared data 
in a storage device, providing thereby the possibil- 
ity of easily processing the data to solve any 
problem that may arise at regeneration of video 
data. 

The present invention can provide an image- 
information storage regenerating device which dis- 
assembles a packet according to attached thereto 
information, establishes synchronization of FEC op- 
eration at a receiving terminal for image regenera- 
tion by sending a fill frame as need be, and then 
transmits stored video data to the terminal, as- 
suring thereby smooth and quick representation of 
stored video data at the terminal; and which regu- 
lates an amount of information at stored image 
regeneration like an image encoder, thereby surely 
preventing the occurrence of overflow or underflow 
of a buffer at a regenerating terminal; and which is 
further capable of matching data transmission rate 
of the sending side to that of the receiving side so 
that a receiving terminal can regenerate stored 
video data even if a channel rate to which the 
terminal is adapted is not the same as a channel 
rate at which the video data to be transmitted 
thereto were stored at the sending side. 

In an image-information storage regenerating 
device according to the present invention, coded 
video data are decoded by a H.261 decoding por- 
tion (video-data decoding portion) and the decoded 



video data are encoded in intra-mode by a H.261 
intra-frame coding portion (intra-frame coding por- 
tion). Coded video data of an initial screen before 
storing pass through the above-mentioned video 

5 decoding portion and intra-frame image coding por- 
tion to - compose an initial screen comprising of _. 
video data encoded in intra-mode only, i.e., not 
including video data coded by motion compen- 
sative inter-frame prediction method. This elimi- 

10 nates the possibility of disorder of the initial screen 
at its reproduction at any AV-terminal, assuring 
correct regeneration of subsequent screens which, 
therefore, is decoded with reference to the intra- 
coded initial screen. 

75 An image-information storage regeneration de- 

vice according to the present invention is provided 
with a screen number rewriting portion which, in 
case of successively transmitting two or more dif- 
ferent image sequences of coded video data from 

20 a storage to an AV - terminal, previously rewrites a 
series of screen numbers (frame numbers) of a 
different video data sequence, that indicates a dis- 
continuity with a last screen number of a preceding 
video data sequence, in such a way that a top 

25 screen (frame) number of the different video data 
sequence may be consecutive with the same incre- 
ment (frame interval) as of the screen (frame) num- 
bers of the preceding video data sequence but the 
succeeding screen (frame) numbers of the different 

30 video data sequence may keep the same un- 
changed increment as of the stored screen (frame) 
numbers of the different video data sequence. This 
processing enables the AV-terminal to receive the 
coded video data of different video data sequences 

35 with rewritten screen (frame) number and to con- 
tinuously reproduce the different videos without 
causing a delay at a junction of the video se- 
quences. 

According to the present invention, it is also 

40 possible to rewrite screen numbers of any stored 
video data sequence to be transmitted to a terminal 
according to a decoding capability of said terminal, 
thereby the terminal can always receive the coded 
video data with screen numbers (frame interval) 

45 rewritten to be decoded by the terminal. 

A multiplexed data storing and regenerating 
device according to the present invention separates 
a multiplexed input of audio/video data into respec- 
tive components by using data demultiplexing por- 

50 tion, corrects an error of the video data by error 
correcting portion for FEC (forward error correc- 
tion), extracts a video frame by using video frame 
extracting portion, assembles a packet with infor- 
mation on multiplexing rate and encoding method 

55 for storing audio/video data and attaches a time 
stamp to the packet by using packet assembling 
portion, and stores thus prepared data in a storage. 
When regenerating the multiplexed data, this de- 
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vice can disassemble the packet according to the 
added thereto information and previously absorb a 
possible differentia! delay between audio/video data 
by using attached thereto time stamps. 

To attain the above-mentioned purposes, the 5 
present invention was made to provide: 

(1) an image-information storage regenerating 
device comprising a multiplexed data transmit- 
ting and receiving portion to receive multiplexed 
data for storing at host side from a terminal for 10 
multiplexing input signals such as audio/video 
signals, over a data communication network, and 

to transmit regenerated data; and storage device 
to store therein multiplexed data of audio/video 
data, which are receivable by the multiplexed 15 
data transmitting and receiving portion for stor- 
ing and readable by the multiplexed data trans- 
mitting and receiving portion for regeneration, 
wherein the multiplexed data transmitting and 
receiving portion separates multiplexed data and 20 
the storage device stores video data by video 
frames or continuous frames; 

(2) an image-information storage regenerating 
device which in addition to the above-mentioned 
device (1), the multiplexed data transmitting and 25 
receiving portion is provided with channel data 
demultiplexing portion to separate an input sig- 
nal of multiplexed audio/video data into respec- 
tive components; error correcting portion to cor- 
rect an error of video data outputted from the 30 
channel data demultiplexing portion; video frame 
extracting portion to extract video frames from 
video data outputted from the error correcting 
portion; and packet assembling portion to as- 
semble a packet of video data outputted from 35 
the video frame extracting portion and audio 
data outputted from the channel data demul- 
tiplexing portion; and the storage device stores 

an assembled packet outputted from the packet 
assembling portion by arranging video data by 40 
video frames or continuous frams; 
(3) an image-information storage regenerating 
device as defined above in item (1) and (2), 
wherein the multiplexed data transmitting and 
receiving portion is provided with packet disas- 45 
sembling portion to disassemble a packet out- 
putted from the storage device into respective 
components; fill bit inserting device to optionally 
insert a fill bit or bits into video data outputted 
from the packet disassembling portion; error so 
correction frame generating portion to produce a 
error correction frames of video data outputted 
from the fill bit inserting portion; and channel 
data multiplexing portion to multiplex video data 
outputted from the error correction frame gen- 55 
erating portion together with data outputted from 
the packet disassembling portion; and the mul- 
tiplexed data transmitting and receiving portion 



can maintain synchronization of error correction 
frame of the communication terminal for regen- 
erating stored video deta; 

(4) an image-information storage regenerating 
device as defined above in item (1) or (2), 
wherein the multiplexed data transmitting and 
receiving portion is provided with packet disas- 
sembling portion to disassemble a packet out- 
putted from the storage device into every kind 
of data; fill bit inserting portion to insert a fill bit 
or bits into video data outputted from the packet 
disassembling portion; data amount supervising 
portion to supervise an information content of 
video data outputted from the packet disassem- 
bling portion and control the fill bit inserting 
portion; error correction frame generating portion 
to produce an error correction frames of video 
data outputted from the fill bit inserting portion; 
and channel data multiplexing portion to mul- 
tiplex video data outputted from the error correc- 
tion frame generating portion and data outputted 
from the packet disassembling portion; and the 
multiplexed data transmitting and receiving por- 
tion can maintain synchronization of error cor- 
rection frame of the communication terminal for 
regenerating stored video data; 
(5) an image-information storage regenerating 
device as defined above in item (1) or (2), 
wherein the multiplexed data transmitting and 
receiving portion is provided with packet disas- 
sembling portion to disassemble a packet out- 
putted from the storage device into respective 
components; transmission speed matching por- 
tion to match transmission rate of the multi- 
plexed data transmitting and receiving portion 
with video data outputted from the packet disas- 
sembling portion; fill bit inserting portion to in- 
sert a fill bit or bits into video data outputted 
from the packet disassembling portion; data 
amount supervising portion to supervise an in- 
formation content of video data outputted from 
the packet disassembling portion and control the 
fill bit inserting portion; error correction frame 
generating portion to produce an error correction 
frame of video data outputted from the fill bit 
inserting portion; and channel data multiplexing 
portion to multiplex video data outputted from 
the error correction frame generating portion to- 
gether with data outputted from the packet dis- 
assembling portion; and the multiplexed data 
transmitting and receiving portion can maintain 
synchronization of error correction frame of the 
communication terminal for regenerating stored 
video data. 

To realize the above-mentioned purposes, the 
present invention was made to provide an image- 
information storage regenerating device for control- 
ling a process for transferring video data from a 
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high-speed digital transmission network to a coded 
video data recording storage and a process for 
storing said information therein, comprising a re- 
ceiving portion, a communication control portion 
and a transmitting portion, characterized in that s 
there are provided with video decoding portion to 
decode coded video data and intraframe video 
coding portion to encode in intra-mode the video 
data decoded by the video decoding portion and 
which transfers coded video data of an initial 10 
screen through the video decoding portion and the 
intra-frame video coding portion to prepare the 
video data coded in intra-mode and stores said 
data in the storage device. 

To attain the above-mentioned purposes, the 75 
present invention was made to provide: (1) an 
image-information storage regeneration device for 
use in a video data communication service to con- 
trol a process of reading coded video data from a 
storage device and transmitting the coded video 20 
data to an audio-visual terminal (hereinafter re- 
ferred as AV-terminal) for decoding and regenerat- 
ing said video data, comprising a video data read- 
ing portion, a screen-image reading portion and 
channel control portion, which is further provided 25 
with a screen number rewriting control portion for 
giving an instruction for rewriting screen numbers 
showing ordinal numbers of video data units to be 
transmitted to the AV-terminal, a transmission- 
frame processing portion for preparing coded video 30 
data by rewriting screen numbers of the video data 
according to the rewriting instruction from the 
screen number rewriting control port ion so as to 
rewrite a screen number of video data at a split of 
sequences before transmitting stored coded video 35 
data in succession to different object video data to 
an AV-terminal, assuring thereby continuous re- 
production of images without a delay due to a 
discrepancy of screen numbers between two dif- 
ferent video data sequences; (2) an image-informa- 40 
Hon storage regeneration device for use in an video 
data communication service system using stored 
therein video data, which comprises a center con- 
trol unit for storing coded video data, reading and 
transmitting said coded video data to a terminal for 45 
decoding the receiving coded video data and re- 
producing it as an video data sequence, a screen 
number rewriting control portion for giving an in- 
struction for rewriting screen numbers showing or- 
dinal numbers of video data to be transmitted by so 
the center control device to the AV-terminal, a 
transmission-frame processing portion for reading 
from the stored coded video data and rewriting 
screen numbers of the video data according to the 
rewriting instruction from the acreen number rewrit- 55 
ing control portion to prepare coded video data to 
be transmitted to the terminal and a terminal-capa- 
bility control portion for controlling decoding capa- 



bility of each terminal, and which, in case of the 
terminal having a minimum frame interval larger 
than the frame interval of the stored coded video 
data, rewrites screen numbers of the read-out cod- 
ed video data and transmits the coded video data 
to the terminal to make it possible to communicate 
with the terminal in such a way to slowly reproduce 
images at the terminal. 

To attain the above-mentioned purposes, the 
present invention was made to provide: 

(1) An image-information storage regenerating 
device for storing multiplexed data of 
audio/video and other information and regenerat- 
ing stored data from any terminal, wherein a 
multiplexed data transmitting and receiving por- 
tion is provided to eliminate a differential delay 
arising between different components by using a 
time stamp attached to stored multiplexed data; 

(2) an image-information storage regenerating 
device, comprising a multiplexed-data transmit- 
ting and receiving portion to receive multiplexed 
data for storage at host side from the terminal 
for multiplexing input signals of audio/video and 
other information, over a network and transmit 
regenerated data, and a storing portion to store 
therein multiplexed data of audio/video and oth- 
er information received by the multiplexed data 
transmitting and receiving portion and to allow 
reading therefrom the stored data for regenera- 
tion, characterized in that the multiplexed data 
transmitting and receiving portion attaches a 
time stamp to each component of the multi- 
plexed data to be stored in the storage device 
and, when regenerating the multiplexed data, 
absorbs a differential delay of the components 
according to the time stamps so that no dif- 
ferential delay of the components may arise in 
regeneration of the multiplexed data; and 

(3) an image-information storage regenerating 
device, comprising a channel data demultiplex- 
ing portion to split multiplexed input signal into 
different respective components, e.g., 
audio/video and other information; an error cor- 
recting portion to correct an error of video data 
outputted from the channel data demultiplexing 
portion; a time stamp generating portion to gen- 
erate a time stamp according to an octet timing 
signal outputted from the channel data demul- 
tiplexing portion; a video frame extracting por- 
tion to extract a video frame from video data 
outputted from the error correcting portion and 
to identify a time stamp of video data from time 
stamp data outputted from the time stamp gen- 
erating portion; a packet assembling portion to 
produce a packet by arranging video data and a 
time stamp outputted from the video frame ex- 
tracting portion, a time stamp outputted from the 
time stamp generating portion and audio data 
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outputted from the channel data demultiplexing 
portion; a storage device to store a packet out- 
putted from the packet assembling portion; a 
packet disassembling portion to receive a pack- 
et outputted from the storage device and dis- 
assemble it into each component data and a 
attached thereto time stamp; a data processing 
portion to make some due processing of each 
component data outputted from the packet dis- 
assembling portion; a differential delay absorb- 
ing portion to absorb a differential delay of dif- 
ferent components according to corresponding 
time stamps outputted from the data processing 
portion; and a channel data multiplexing portion 
to multiplex data components outputted from the 
differential delay absorbing portion; whereby a 
posible differential delay of the processed com- 
ponent data can be absorbed. 

BRIEF DESCRIPTION OF DRAWINGS 

Fig. 1 is a construction view of a conventional 
multiplexed data transmitting and receiving portion. 

Figs. 2A and 2B show a conventional mul- 
tiplexed channel data format. 

Fig. 3 shows a conventional stored packet for- 
mat. 

Fig. 4 is a construct ion view of a conventional 
image-information storage control system. 

Fig. 5 is a view for explaining a hierarchical 
structure of conventional image data. 

Fig. 6 is a construction view of a conventional 

coding portion. 

Fig. 7 is a view for explaining conventional 

error correction frame. 

Fig. 8 is a construction view for explaining a 
conventional motion-compensated interframe pre- 
dictive coding. 

Fig. 9 is a construct ion view of a conventional 

decoder. 

Figs. 10A, 10B and 10C are a view for explain- 
ing a principle of motion-compensated interframe 
predictive coding method. 

Fig. 11 is a view for explaining a correlation 
between a transmitted and regenerated video data 
according to a conventional image-information re- 
generation control device. 

Fig. 12 is a construction view for explaining an 
image-information storage regenerating device em- 
bodying the present invention. 

Fig. 13 is a construction view of a multiplexed 
data transmitting and receiving portion of a image 
storage and communication system. 

Figs. 14A, 14B and 14C are illustrative of video 
data between modules of the receiver shown in 
Fig. 13. according to the present invention. 

Fig. 15 is illustrative of a stored paket format 
according to the present invention. 



Fig. 16 is a construction view of a transmitter of 
multiplexed data transmitting and receiving portion 
shown in Fig. 12. 

Figs. 17A, 17B and 17C are illustrative of video 
s data between modules of the transmitter shown in 
Fig. 16. 

Fig. 18 is another construction view of a trans- 
mitter of multiplexed data transmitting and receiv- 
ing portion shown in Fig. 12. 
70 Figs. 19A, 19B, and 19C are illustrative of 

video data between modules of the transmitter 
shown in Fig. 18. 

Fig. 20 is another construction view of a trans- 
mitter of multiplexed data transmitting and receiv- 
es ing portion shown in Fig. 12. 

Figs. 21 A, 21 B, 21 C and 21 D are illustrative of 
video data between modules of the transmitter 
shown in Fig. 20. 

Fig. 22 is an another construction view for 
20 explaining an image-information storage regenerat- 
ing device embodying the present invention. 

Fig. 23 is a flow chart of image data for ex- 
plaining the operation of an image-information stor- 
age regenerating device shown in Fig. 22. 
25 Fig. 24 is an another construction view for 

explaining an image-information storage regenera- 
tion device embodying the present invention. 

Fig. 25 shows an example of connection of an 
video data regeneration control device of the 
30 present invention with receiving terminals. 

Figs. 26A and 26B are an explanatory view 
showing a correlation between screen (frame) num- 
bers of video data stored. 

Fig. 27 is an explanatory view 1 showing a 
35 correlation between screen (frame) numbers of 
stored video data and screen (frame) numbers of 
video data to be transmitted by an image-informa- 
tion storage regeneration device according to the 
present invention. 
40 Fig. 28 is an explanatory view 2 showing a 

correlation between screen (frame) numbers of vid- 
eo data transmitted and screen (frame) number of 
video data regenerated by an image-information 
storage regeneration device according to the 
45 present invention. 

Fig. 29 is a construction view of a center con- 
trol device shown in Fig. 25. 

Fig. 30 is a view showing a state of data stored 
in an video data storing portion of an image-in- 
50 formation storage regeneration device according to 
the present invention. 

Fig. 31 is a view showing an example of trans- 
mitted frames shown in Fig. 30. 

Fig. 32 is a construction view of a multiplexed 
55 data transmitting and receiving portion shown in 
Fig. 12. 

Fig. 33 is illustrative of a stored packet format 
according to the present invention. 
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PREFERRED EMBODIMENT OF THE INVENTION 

Fig. 1 is a construction view of a conventional 
multiplexed data transmitter and receiver device. In 
Fig. 1,1 is a storing data extracting portion, 2 is a 5 
packet assembling portion, 3 is a packet disassem- 
bling portion, 4 is a channel data generating por- 
tion, 5 is a multiplexed data receiving portion and 6 
is a multiplexed data transmitting portion. 

The storing data extracting portion 1 extracts w 
specified multiplexed data from the received chan- 
nel multiplexed data according to an instruction of 
a system control portion. The packet assembling 
portion 2 assembles a packet from the received 
multiplexed data according to an instruction of the 75 
system control portion. The packet disassembling 
portion 3 extracts reproducible multiplexed data 
from the packet outputted by the storage device. 
The channel data generating portion 4 generates 
channel multiplexed data from multiplexed data 20 
outputted by the packet disassembling portion ac- 
cording to an instruction of the system control 
portion. 

Figs. 2A and 2B show a conventional channel 
data multiplexing format that is used for multiplex- 25 
ing data, e.g., data for use in visual telephone 
service. This format method is designated as an 
international standard and, therefore, can assure 
the inter-connectability of, e.g., visual telephones. 
As shown in Figs. 2A and 2B, the format includes 30 
areas 11 and 12 allocated respectively for audio 
data and video data, a frame synchronization bits 
13 and bits 14 for interchange of capability-com- 
mand between terminals. An order of sending data 
into a communication circuit is indicated with nu- 35 
meral 15. Data multiplexing conditions can always 
be changed by using capability-command commu- 
nication bits 14. 

Fig. 3 shows a conventional format of a packet 
to be stored. A header 21 contains information on a 40 
storing transmission rate, multiplexing rate and a 
data encoding method. Numeral 22 denotes a 
quantity of sub-multiframes comprised of packets, 
and numeral 23 indicates multiplexed data pro- 
duced by using the format shown in Fig. 2. 45 

In storing, channel multiplexed data coming 
from a network is received by the data extracting 
portion 1 that extracts therefrom multiplexed data 
to be stored and transfers the extracted data to the 
packet assembling portion 2. The packet assem- 50 
Wing portion 2 assembles packets from the ex- 
tracted multiplexed data according to the packet 
format of Fig. 3. A header of the format includes 
information on the transmitted data multiplexing 
rate and their encoding method. The packets are 55 
transferred as packet data to the storage device. 

In regeneration, the packet data from the stor- 
age device is received by the packet disassem- 



bling portion 3 that informs the system control 
portion of the header information of each packet. 
The system control portion 3 directs the channel 
data generating portion 4 to match the operating 
mode of a terminal at storing side with that of a 
terminal at regenerating side by using BAS 14 
shown in Fig. 2. After matching is realized by the 
channel data generating portion, the packet disas- 
sembling portion 3 disassembles the packets and 
transfers the multiplexed data for regeneration to 
the channel data generating portion 4 that in turn 
rewrites FAS 13 and BAS 14 (Fig. 2) of the re- 
ceived multiplexed data and sends the prepared 
channel multiplexed data into the communication 
network. 

Fig. 4 shows a configuration of a conventional 
image-information storage control system which in- 
cludes terminals 31a-31e, a digital transmission 
network 32, an video data storage control device 
33, a receiving portion 34, a communication control 
portion 35, a transfer portion 36 and storage (re- 
cording) portion 37. At present, the video data 
storage control device is intended to be connected 
with audio-visual terminals (hereinafter called as 
AV-terminal) based upon the recommendation of 
ITU-T (International Telecommunication Union 
Telecommunication Standerdization Sector ). The 
video data coding will conform to the system de- 
fined by the recommendation H.261. 

As shown in Fig. 4, the conventional image- 
information storage control device is comprised of 
the communication control portion 35, the receiving 
portion 34 and the transfer portion 36. When a 
storing start instruction is given from the commu- 
nication control portion 35, coded video data re- 
ceived by the receiving portion 34 are transferred 
through the transfer portion 36 to the storage de- 
vice 37 (recording device like a host machine). The 
transfer operation is ended with a storing end in- 
struction. The coded video data, as mentioned 
above, are video data according to the recommen- 
dation H.261. This coding method will be described 
below: 

Fig. 5 shows a hierarchical structure of coded 
video data according to the recommendation 
H.261. The hierarchy may be supposed as two- 
dimensionaily divided units for coding within a 
frame of video data, i.e., an video frame (frame), a 
group of blocks (GOB), a macro block (MB) and a 
block in descending order. Among them, the video 
frame and the group of blocks include, respec- 
tively, a self-synchronizing information in terms of a 
unique word (PSC, GBSC) whereby a decoder can 
recover synchronization at the beginning of com- 
munication and in event of occurrence of transmis- 
sion error. Accordingly, each of these two units 
may be considered as a transmissible structure 
unit of coded data. 
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Fig. 6 is a construction view of a coder accord- 
ing to the recommendation H.261, which includes 
an source coding portion 41 and a transmission 
coding portion 42. The recommendation H.261 de- 
fines that a coder is provided with a source coding 
portion 41 for producing coded data with a reduced 
amount of information contained in an video and a 
transmission coding portion 42 that makes the cod- 
ed data adapted to the transmission line by giving 
them the resilience against transmission error and 
inserting dummy information for absorbing variation 
of an information amount of coded data after cod- 
ing. The transmission coding portion 42 mainly 
performs forward error correction (FEC) coding of 
source coded image data. 

fc Fig. 7 shows a structure of an error correction 
frame. The recommendation H.261 uses codes of 
(511, 493) BCH-code (Bose Chaundhuri Hocquen- 
ghem code). Forward error correction coded data 
are made up of an error correction frame (FEC 
frame) which is composed of an error correction 
frame bit (1 bit) for synchronizing a FEC frame 
according to a synchronization bit pattern, a fill 
identifier (Fi) (1 bit), 492 bits of coded image data 
or fill bits (data of all 1) and 18 bits of error 
correction parity. The coded data thus prepared 
are then transmitted. 

Fig. 8 shows a structure of a motion compen- 
sative inter-frame prediction coding system which 
includes a differential arithmetic unit 51, an error 
coding portion 52, an error decoding portion 53, an 
adder portion 54, a frame memory portion 55 and a 
motion compensative inter-frame predicting portion 
56. 

Coding algorithm according to the recommen- 
dation H.261 is such that video data is coded by 
hybrid image coding method which is a combina- 
tion of motion compensative inter-frame prediction 
and intra-frame orthogonal transform coding. In the 
hybrid coding system, an information content of 
video data is reduced by using motion compen- 
sative inter-frame prediction and video data can be 
alternatively encoded in intra-mode (for coding 
within a frame only) that means refreshing. This 
intra-mode is applied at specified time intervals to 
prevent occurrence of a mismatch between a send- 
ing side and a receiving side due to calculation 
error or transmission error, and that is also useful 
in case when the coding frame does not have 
much correlation with a preceding one. The hybrid 
coding system encodes a series of images mainly 
by inter-frame motion compensative prediction. 

Fig. 9 is a construction view of a decoder that 
includes a transmission decoding portion 61 and a 
source decoding portion 62. Decoding method ac- 
cording to the recommendation H.261 has a flow 
chart reverse to that of the fore-described coding 
methods according to the same recommendation. 



In video data storing, a transmitting AV-terminal 
according to the recommendation H.261 encodes 
successive objective frames by motion compen- 
sative inter-frame prediction and sends the en- 
5 coded video data as shown in Fig. 10A. When an 
video data storing center starts storing operation, 
coded image data by screens, for example, B 0 -B n 
as shown in Fig. 10A are read-out and stored in a 
storage such as a host machine. In this case, the 
f 0 screen B 0 is encoded by prediction with reference 
to the frame B-i. 

In image reproduction, as shown in Fig. 10B, 
the coded video data, e.g., stored frames A- 3 - Ai 
and Bo-B n are successively read from the host 
75 machine by the video data storage center and sent 
to an AV-terminal. These data maintain an integrity 
of coded video data and they are, therefore, nor- 
mally decoded at the AV-terminal. 

While the screen B 0 is, however, predicted with 
20 reference to the screen B-i at the time of data 
storing (i.e., coding), it will be decoded with refer- 
ence to the screen A-i that becomes a preceding 
object at the time of video decoding. Namely, the 
screen B 0 is predicted according to different 
25 screens at coding and decoding. As the result, the 
screen Bo can not correctly be reproduced and 
displayed at the AV-terminal. Furthermore, this 
may affect the subsequent screens since screens 
Bi - B n have been coded in succession by inter- 
30 frame prediction. The screen images may be 
damaged. 

In the conventional image-information regen- 
eration control device, as described above, a 
screen number (frame number) of video data 

35 (frame data) to be transmitted and received by an 
audio-visual terminal is the same as that of the 
corresponding video data stored in a storage. 
Namely, the stored video data with its unchanged 
screen (frame) number are transmitted to the termi- 

40 nal. For example, as shown in Fig. 11, when video 
data are stored in the order of screen (frame) 
numbers "10, 12, 15, 17 ...". corresponding video 
data to be transmitted are given the same frame 
numbers "10, 12, 15, 17 ...". Accordingly, when 

45 such video data are regenerated in succession to a 
currently displayed image or video data of different 
object, a discrepancy of screen numbers may oc- 
cur at a junction between two different video se- 
quences. 

50 For instance, in case of continuously displaying 

the stored video data in success ion to a sequence 
of screen images as shown in Fig. 11, jointed 
screen (frame) numbers are described as "screen- 
image (1), screen-image (3), screen-image (5), vid- 

55 eo data(10), video data (12), video data(15) ..." 
which is transmitted without any modification. This 
causes the audio-visual terminal to regenerate the 
received video data in the order of their screen 
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(frame) numbers with a discrepancy of screen 
(frame) numbers between "screen-image (5)" and 
"video data (10)", i.e., an farame interval corre- 
sponding to a split of image sequences. In this 
case, video data behind the frame interval is regen- 
erated with a delay time. 

Referring to drawings, a preferred embodiment 
of the present invention will be described as fol- 
lows: Fig. 12 is a construction view for explaining 
an example of an image-information storage regen- 
erating device according to the present invention. 
There are shown a communication terminal 71, a 
communication host 72, a communication network 
73 (e.g., ISDN), an image input camera 74, an 
image output monitor 75, an audio input-output 
handset 76, a terminal system control portion 77, a 
video coding/decoding portion 78, an audio cod- 
ing/decoding portion 79, a multiplexed data trans- 
mitting and receiving portion 80 of the communica- 
tion terminal 71 for multiplexing encoded 
audio/video data and control information, and send- 
ing multiplexed data to a channel, a host system 
control portion 81, a multiplexed data transmitting 
and receiving portion 82 of the host 72 for demul- 
tiplexing control data from multiplexed data and 
multiplexing the demultiplexed control data, and a 
storage device 93 for storing data. 

Moving-pictures taken by an image input cam- 
era 74 of a communication terminal 71 are en- 
coded by inter-frame prediction by the video cod- 
ing/decoding portion 78 while audio signals input- 
ted through the handset 76 are encoded by the 
audio coding/decoding portion 79. The coded video 
data are multiplexed together with the coded audio 
data and control information by the multiplexed 
data transmitting and receiving portion 80 and 
transmitted over the communication network 73 to 
the host 72. At the host side, the multiplexed data 
sent from the communication terminal 71 are re- 
ceived by the multiplexed data transmitting and 
receiving portion 82 whereby packet data to be 
stored is formed from the received multiplexed 
audio/video data and transferred to the storage 
device 83 wherein the packet data are stored in the 
form of suitable files, i.e., the video data are stored 
as arranged frame by frame or continuous frames. 

The stored data are read from the storage 
device 83 by the request of a user or the host and 
transferred to the multiplexed data transmitting por- 
tion 82 of the host 72, which, according to an 
instruction given by the system control portion 81, 
rewrites the control information of the data, that has 
been stored as unchanged, and then transmits the 
data with the new control information over the 
communication network to the communication ter- 
minal 71 . At the terminal side, the multiplexed data 
with the rewritten control information from the host 
side are received by the multiplexed data receiver 



portion 80 that splits the multiplexed data into the 
control information, audio/video data and sends the 
control information to the system control portion 
77. 

5 The coded video data received and demul- 

tiplexed by the multiplexed data transmitting and 
receiving portion 80 are transferred to the video 
coding/decoding portion 78 that decodes the video 
data according to an instruction of the system 

70 control portion 77 and displays moving-pictures on 
a display screen of the monitor 75. The demul- 
tiplexed audio data are decoded and regenerated 
by the audio coding/decoding portion 79 and out- 
putted through the handset 76. Since communica- 

75 tion over the channel is always conducted in two- 
ways during both 'store 1 and 'regenerate 1 oper- 
ations, the control information can be transmitted to 
and from the terminal irrespective of existence or 
absence of the video data while the channel is kept 

20 ON therebetween. 

Fig. 13 is a construction view of a multiplexed 
data transmitter and receiver device. In Fig. 13, 89 
is a receiving portion of the multiplexed data trans- 
mitter and receiver device, 90 is a transmitting 

25 portion of the multiplexed data transmitter and re- 
ceiver device, 91 is a channel data demultiplexing 
portion, 92 is an error correcting portion according 
to forward error correction (FEC) control system, 
93 is a video frame extracting portion, 94 is a 

30 packet assembling portion, 95 is a packet disas- 
sembling portion, 96 is a data processing portion 
and 97 is a channel data multiplexing portion. 

The channel data demultiplexing portion 91 
separates received channel multiplexed data into 

35 different components such as audio/video data and 
other information according to an instruction of a 
system control portion (not shown). The error cor- 
recting portion 92 performs error correcting opera- 
tion on video data outputted from the channel data 

40 demultiplexing portion 91. The video frame extract- 
ing portion 93 extracts a video frame from the error 
corrected data. The packet assembling portion 94 
produces a packet by collecting the video frame 
from the video frame extracting portion 93 and 

45 audio data from the channel data demultiplexing 
portion 91. The packet disassembling portion 95 
demultiplexes a packet read from a storage device 
into audio/video data. The data processing portion 

96 performs some due processing operation on the 
50 data outputted from the packet disassembling por- 
tion 95 and the channel data multiplexing portion 

97 produces channel multiplexed data from the 
data outputted from the data processing portion 96. 

Figs. 14A to 14C are illustrative of video data 
55 A, B and C between modules of the receiver por- 
tion shown in Fig. 13. Fig. 14A corresponds to a 
signal "A" shown in Fig. 13, which is comprised of 
a synchronizing signal for FEC, parity bits, fill bits 
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for adjusting an amount of coded data and an 
information bit. Fig. 14B corresponds to a signal 
"B" shown in Fig. 13, which is corrected for error 
and relieved of redundant data, e.g., fill bits. Fig. 
14C corresponds to a signal "C" shown in Fig. 13, 
which is a video frame extracted by PSG (picture 
start code). 

Fig. 15 shows a structure of a packet to be 
stored, which includes information: a header con- 
taining information 111 on multiplexing rate at stor- 
ing, encoding method and encoding capability; a 
video data length 112, a audio data length 113; the 
number of video frames 114 in a paket; a data 
length of a video frame and video frame data 1 1 5; 
and audio data 1 1 6. 

The operation of the image-information storage 
regenerating device according to the present inven- 
tion is as follows: 

At data storing, the channel data demultiplex- 
ing portion 91 splits the multiplexed data received 
through the network into audio/video data and other 
components and, then, transfers the video data to 
the error correcting portion 92 and audio data to 
the packet assembling portion 94. The error cor- 
recting portion 92 receives video data as a signal in 
the state shown in Fig. 14A, conducts error correc- 
tion of the data and outputs video data as a signal 
in the state shown in Fig. 14B to the video frame 
extracting portion 93 that in turn searches PSC 
(picture start code) in the received data and out- 
puts data in the state shown in Fig. 14C to the 
packet assembling portion 94. The packet assem- 
bling portion 94 assembles a packet of received 
audio/video data according to the packet format 
shown in Fig. 15, then it writes the header informa- 
tion on multiplexing rate, encoding method and 
coding capability necessary for regeneration of the 
data and outputs the prepared data to the storage 
device 83. 

Fig. 16 is a construction view of a transmitter of 
the multiplexed data transmitting and receiving 
means shown in Fig. 12. There are shown a packet 
disassembling portion 121, a fill bit inserting portion 
122, a FEC frame generating portion 123 and a 
channel data multiplexing portion 124. The packet 
disassembling portion 121 disassembles a received 
packet into audio/video data and other data. The fill 
bit inserting portion 122 inserts fill bits into the 
video data outputted from the packet disassem- 
bling portion 121. The FEC frame generating por- 
tion 1 23 produces a FEC frame from the video data 
outputted from the fill bit inserting portion 122. The 
channel data multiplexing portion 124 generates a 
channel multiplexed data from the video data out- 
putted from the FEC frame generating portion 123 
and the audio data outputted from the packet dis- 
assembling portion 121. 



Figs. 17A to 17C are illustrative of video data 
between modules of the transmitter portion shown 
in Fig. 16. Fig. 17A corresponds to a signal "D" 
shown in Fig. 16, which is a video frame data. Fig. 
5 17B corresponds to a signal "E" shown in Fig. 16, 
- - which, is filled .with fill bits. Fig. 17C„ corresponds to 
a signal "F" shown in Fig. 16, which is a FEC 
frame containing a synchronizing signal for FEC 
and parity bits for correction of transmission error. 
w The operation of the transmitter portion shown 

in Fig. 16 is as follows. 

At data regenerating, the packet disassembling 
portion 121 receives a packet outputted from the 
storage device 83, extracts therefrom header in- 
ts formation and transfers it to the system control 
portion 81 that in turn instructs the channel data 
multiplexing portion 124 to match with each other 
the operating modes of a regenerating side termi- 
nal and a sending side terminal by using BAS 14 
20 shown in Fig. 2. After matching for operation mode 
of the terminal is completed at the channel data 
multiplexing portion 124, the packet disassembling 
portion 121 disassembles a packet and transfers 
video data to the fill bit inserting portion 122 and 
25 audio data and other information to the channel 
data multiplexing portion 124. 

The fill bit inserting portion 122 inserts fill bits 
into the video data to enable the communication 
terminal to establish and maintain synchronization 
30 of FEC frame before regenerating the stored video 
data thereat, then it transfers the video data to the 
FEC frame generating portion 123 that in turn pro- 
duces a FEC frame and transfers it to the channel 
data multiplexing portion 124. The channel data 
35 multiplexing portion 124 multiplexes video data to- 
gether with audio data according to a multiplexing 
format showing in Fig. 2 and sends the multiplexed 
data into the network. 

The present invention provides a data storing 
40 format adapted to effectively overcome problems, 
which may arise at data regeneration in a video 
storage and delivery system, and realizes quick 
and smooth regeneration of stored video data. 
Namely, the channel data demultiplexing portion 91 
45 takes the multiplexed input data to respective com- 
ponents. The error correcting portion 92 corrects 
an error of video data outputted from the channel 
data demultiplexing portion 91. The video frame 
extracting portion 93 extracts a video frame from 
50 the data outputted from the error correcting portion 
92. The packet assembling portion 94 assembles a 
packet of the video data outputted from the video 
frame extracting portion 93 and the audio data 
outputted from the channel data demultiplexing 
55 portion 91. The storage device 83 stores therein 
the packet outputted from the packet assembling 
portion 94. Accordingly, video data are stored as 
video frames in the storage device 83. 
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A packet comprised of video data and audio 
data with header information is outputted from the 
storage device 83 to the packet disassembling 
portion 121 that disassembles said packet. The fill 
bit inserting portion 122 inserts fill bits in video 5 
data outputted from the packet disassembling por- 
tion 121. The FEC frame generating portion 123 
generates a FEC frame from the video data output- 
ted from the fill bit inserting portion 122. The 
channel data multiplexing portion 124 produces io 
multiplexed data of video data outputted from the 
FEC frame generating portion 123 and of audio 
data and other information outputted from the pack- 
et disassembling portion 121. Thus multiplexed 
data are effective to control synchronization at the 75 
terminal for regeneration of delivered images. 

Fig. 18 shows another construction of a trans- 
mitter of the multiplexed data transmitting and re- 
ceiving portion shown in Fig. 12. There are in- 
dicated a transmitter portion 106, a packet disas- 20 
sembling 131, a fill bit inserting portion 132, a FEC 
frame generating portion 133, a channel data mul- 
tiplexing portion 134 and a data amount supervis- 
ing portion 135. 

The packet disassembling portion 131 disas- 25 
sembles a received packet into audio/video data. 
The fill bit inserting portion 132 inserts fill bits into 
the received video data. The FEC frame generating 
portion 1 33 produces a FEC frame of the received 
video data. The channel data multiplexing portion 30 
134 generates channel multiplexed data. The data 
amount supervising portion 135 monitors an 
amount of information and controls insertion of fill 
bits as need be. 

Figs. 19A to 19C are illustrative of video data 35 
between modules of the receiver portion shown in 
Fig. 18. Fig. 19A corresponds to a signal "G" 
shown in Fig. 18, which is video frame data. Fig. 
19B corresponds to a signal "H w shown in Fig. 18, 
which is data filled with fill bits. Fig. 19C cor- 40 
responds to a signal "I" shown in Fig. 18, which is 
a FEC frame containing a synchronizing signal for 
FEC and parity bits for transmission error correc- 
tion. 

The operation of the transmitter portion shown 45 
in Fig. 18 is as follows. 

At data regenerating, the packet disassembling 
portion 131 receives a packet outputted from the 
storage device 83, extracts therefrom header in- 
formation and transfers it to the system control so 
portion 81 that in turn directs the channel data 
multiplexing portion 89 to make the operating 
mode of receiving side terminal with that of send- 
ing side terminal by using BAS 14 shown in Fig. 2. 
After matching is completed at the channel data 55 
multiplexing portion 134, the packet disassembling 
portion 131 disassembles a packet, transfers video 
data to the fill bit inserting portion 132 and the data 



amount supervising portion 135 and transfers audio 
data and other information to the channel data 
multiplexing portion 134. 

The fill bit inserting portion 132 inserts fill bits 
into the video data under control of the data 
amount supervising portion 135 and transfers the 
video data to the FEC frame generating portion 133 
that in turn produces a FEC frame and transfers it 
to the channel data multiplexing portion 134. The 
channel data multiplexing portion 134 multiplexes 
audio/video data according to a multiplexing format 
shown in Fig. 2 and enters the multiplexed data 
into the network. 

The present invention is thus directed to pre- 
vent any terminal from being subjected to overflow 
and underflow of its buffer memory when regener- 
ating video data in a video storage and delivery 
system. 

A packet comprised of audio/video data with 
header information is outputted from the storage 
device 83 to the packet disassembling portion 131 
that disassembles said packet. The fill bit inserting 
portion 132 inserts fill bits into video data outputted 
from the packet disassembling portion 131. The 
data amount supervising portion 135 monitors an 
amount of the video data outputted from the packet 
disassembling portion 131 and controls the fill bit 
inserting portion 132. The FEC frame generating 
portion 133 generates a FEC frame from the video 
data outputted from the fill bit inserting portion 132. 
The channel data multiplexing portion 134 pro- 
duces multiplexed data of the video data outputted 
from the FEC frame generating portion 133 to- 
gether with the audio data and other information 
outputted from the packet disassembling portion 
131. The information amount of the stored image is 
thus controlled for regeneration at a terminal. 

Fig. 20 shows another construction of a trans- 
mitter of the multiplexed data transmitting and re- 
ceiving portion shown in Fig. 12. In Fig. 20, nu- 
meral 136 designates a transmission rate matching 
portion and other potions similar in function to 
those of Fig. 18 are given the same reference 
numerals. 

The tranission rate matching portion 136 regu- 
lates an output of the received video data to match 
with due transmission rate. For instance, video data 
which were stored at a rate of 10 video frames for 
a second, 10 video frames are outputted for a 
second, irrespective of a data transmission rate at 
data regeneration. 

Figs. 21 A to 21 D are illustrative of video data 
between modules of the receiver portion shown in 
Fig. 20. Fig. 21A corresponds to a signal "J" 
shown in Fig. 20, which is video frame data. Fig. 
21 B corresponds to a signal "K" shown in Fig. 20, 
which is video frame data with a controlled output. 
Fig. 21C corresponds to a signal "M" shown in Fig. 
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20, which is filled with fill bits. Fig. 21 D corre- 
sponds to a signal M N" shown in Fig. 20, which is a 
FEC frame containing a synchronizing signal for 
FEC and parity bits for transmission error correc- 
tion. 

" The operation of the transmitter portion shown 
in Fig. 20 is as follows. 

At data regenerating, the packet disassembling 
portion 131 receives a packet outputted from the 
storage device 83, extracts therefrom header in- 
formation and transfers it to the system control 
portion 81 that in turn directs the channel data 
multiplexing portion 134 to match the operating 
mode of the receiving side with that of the sending 
side by using BAS 14 shown in Fig. 2. If the 
channel data multiplexing portion 134 can not re- 
alize operation mode matched with the receiving 
terminal because the receiving terminal for regen- 
eration has faster channel rate than a terminal that 
transmitted the stored data, it changes the trans- 
mission rate with the receiving terminal in an op- 
eration mode being closest to that of the terminal 
side. After completion of changeing the transimis- 
son rate with the receiving terminal, the packet 
disassembling portion 131 disassembles a packet 
and transfers video data to the transmission rate 
matching portion 136 that in turn adjusts an output 
of the received video data and transfers the video 
data with the controlled output to the fill bit insert- 
ing portion 132 and the data amount supervising 
portion 135. 

The fill bit inserting portion 132 inserts fill bits 
into the video data under control of the data 
amount supervising portion 135 and transfers the 
video data to the FEC frame generating portion 133 
that in turn produces a FEC frame and transfers it 
to the channel data multiplexing portion 134. The 
channel data multiplexing portion 134 multiplexes 
audio/video data according to a multiplexing format 
showing in Fig. 2 and transmits the multiplexed 
data over the network to the terminal. 

As described above, the present invention en- 
ables a video storing and delivery system to regen- 
erate stored video data at a terminal even if the 
latter has a different transmission rate from the 
transmission rate of the video data at storing. 
Namely, the packet disassembling portion 131 dis- 
assembles a packet comprised of audio/video data 
with header information. The transmission rate 
matching portion 136 performs matching a trans- 
mission rate of the video data outputted from the 
packet disassembling portion 131, The data 
amount supervising portion 135 monitors an 
amount of the video data and the fill bit inserting 
portion 132 inserts fill bits into the video data. The 
FEC frame generating portion 133 generates a FEC 
frame from the video data outputted from the fill bit 
inserting portion 132. The channel data multiplex- 



ing portion 134 produces multiplexed data of the 
video data outputted from the FEC frame generat- 
ing portion 133 together with the audio data and 
other information outputted from the packet disas- 
5 sembling portion 131. The above-mentioned pro- 
cessing makes it possible to regenerate the stored 
video data at a terminal having a transmission rate 
different from that of the data storing side. 

Fig. 22 is an another construction view for 
w explaining an example of image-information storage 
regenerating device according to the present inven- 
tion, which includes a receiving portion 141, a 
communication control portion 142, a transfer por- 
tion 143, a decoding portion (H.261) 144 and an 
15 intra-frame coding portion (H.261) 145. 

First, the receiving portion 141 receives coded 
video data and sends said data to the decoding 
portion (H.261) 144 or the transfer portion 143 
under the control of the communication control 
20 portion 142. The coded video data are convention- 
ally coded video data which are, similarly as usual 
video data, are encoded by hybrid coding method 
combining motion compensative inter-frame predic- 
tion with intra-frame orthogonal transform coding. 
25 The communication control portion 142 switch- 

es over control channel of transfer portion 143 and 
an video data transmission line in the state of 
beginning or ending of data storing.. The decoding 
portion (H.261) 144 decodes the coded video data 
30 to reproduce the video data. This portion, like a 
usual decoder H.261 , executes processing such as 
motion compensative prediction decoding and in- 
verse discrete cosine transform (inverse DCT). 

In the intra-frame coding portion (H.261) 145, 
35 the video data decoded by the decoding portion 
(H.261) 144 are encoded again but in the intra- 
mode only. The transfer portion 143 receives the 
coded video data from the intra-frame coding por- 
tion (H.261) 145 or the receiving portion 141 and 
40 transfers said data to the host center (storage) 
under the control of the communication control 
portion 142. 

Fig. 23 is a flow chart for explaining the opera- 
tion of the image-information storage regenerating 

45 device according to the present invention shown in 
Fig. 22. The operation of this device is as follows: 

During a data storing cycle from the storing 
end to the storing start (with an initial screen - the 
first unit of a moving video sequence), coded video 

so data are first received (step 1), check is made 
whether storing being executed or not (step 2), 
and, if not, the received coded data are decoded 
(step 3). Next, check is made whether the data 
relates to an initial screen with which storing starts 

55 (step 4), and, if not, the operation returns to step 1. 
If the data is an initial screen, said initial screen is 
read out from a frame memory of the decoding 
portion (H.261) 144 (step 3) and is sent through the 
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intra-frame coding portion (H.261) 145 to the trans- 
fer portion 143 (step 5). Upon receipt of a "trans- 
fer" command from the communication control por- 
tion 142 the transfer portion 143 starts transferring 
the video data. It stops the operation when the 
storing is finished (step 6). 

The intra-frame coding portion (H.261) 145 en- 
codes an initial screen of moving video sequence 
in the intra-mode specified in the recommendation 
H.261 and outputs it as coded video data. For this 
purpose, the intra-frame coding portion (H.261) 145 
does not needs to execute inter-frame predictive 
coding of video data, thereby it becomes unnec- 
essary to perform motion compensative prediction, 
which takes a grater part of processing load for a 
usual H.261 coder, and to use a frame memory for 
that purpose. Consequently, the intra-frame coding 
portion 145 is required to perform very simple 
processing and have a simple hardware like a still 
image coder. 

When the device being in the state of storing 
video data, i.e., step 2 judges the video data are 
now stored, coded video data, which are subse- 
quent to an initial screen comprising of video data 
coded in the intra-mode only, are sent screen by 
screen directly from the receiving portion 141 to 
the transfer portion 143, bypassing the coding por- 
tion (H.261) 144 and the intra-frame coding portion 
(H.261) 145. They are further sent to the storage 
and stored therein. 

As described above, according to the present 
invention, an initial screen of coded video data to 
be stored is a frame of video data coded by intra- 
frame coding, which serves as a reference frame to 
which subsequent frame relates, and further frames 
are of video data coded by hybrid coding method 
using a combination of conventional motion com- 
pensative inter-frame predictive coding and intra- 
frame orthogonal transfer coding. Therefore, it be- 
comes possible to make up a sequence of video 
data, which has a frame coded by intra-frame cod- 
ing at the head and includes subsequent frames 
coded by conventional hybrid coding method. 

Fig. 24 is an another construction view for 
explaining an example of image-information storage 
regeneration device according to the present inven- 
tion, which includes an video data reading portion 
1 51 , a screen-image reading portion 1 52, a screen 
number rewriting control portion 153, a transmis- 
sion frame processing portion 154 and a channel 
control portion 155. 

First, the video data reading portion 151 reads 
video data, which are encoded according to an 
encoding system based upon the ITU-T recom- 
mendation H.261 , from a storage device. The 
screen-image reading portion 152 reads conversa- 
tional screen-images, i.e., pages (screenfuls) of in- 
formation such as to indicate a service menu or a 



guidance to use the service. The screen number 
rewriting control portion 153 gives an instruction to 
rewrite screen (frame) numbers of the coded in- 
formation stored in the storage device and read-out 

5 therefrom for further transmission to an AV-termi- 
nal, The transmission frame processing portion 154 
rewrites screen (frame) numbers of the coded vid- 
eo data read by both the video data reading portion 
151 and the screen-image reading portion 152 ac- 

w cording to the instruction given by the screen 
(frame) number rewriting control portion 153 to 
prepare frame information for transmisson, which 
are transmitted by the channel control portion 155 
over a communication channel to the AV-terminal. 

75 Fig. 25 is a view for explaining an exemplified 

system in which a video data regeneration control 
device embodying the present invention is used in 
combination with receiving terminals. The system 
includes a storage device 161, an video data con- 

20 trol device 162, a communication channel 163, AV- 
terminals 164-1 - 164-n and a center control device 
165. 

The storage device 161 stores records of cod- 
ed video data. The video data regeneration control 

25 device 162 is an embodiment of the present inven- 
tion, which reads video data and screen-images 
from the storage device 161 and transmits them to 
the AV-terminal 164-1. The center control device 
165 is comprised of the storage device 161 and the 

30 video data regeneration control device 162. The 
communication channel 163 may be a public net- 
work or a private channel. The AV-terminals 164-1 - 
164-n are adapted to communicate with the video 
data regeneration control device 1 62 over the com- 

35 munication channel 163 and receives coded video 
data from the storage device 161 and regenerates 
the data in the form of video images on its display 
screen. 

Figs. 26A and 26B show a correlation between 

40 frames and screen numbers (frame numbers) of 
video data encoded according to the encoding 
method defined by the ITU-T recommendation H. 
261 and stored in the storage device 161. Fig. 26A 
shows a sequence of video data(1) and Rg. 26B 

45 shows a sequence of video data(2). The frames are 
given respective serial screen (frame) numbers. 

Fig. 27 is a view showing a correlation between 
screen (frame) numbers of video data to be trans- 
mitted and screen (frame) numbers of stored video 

50 data when transmitting coded video data of dif- 
ferent objects from a storage to an AV-terminal. An 
example of communication between the video data 
regeneration control device and an AV-terminal is 
described as follows: 

55 Upon receipt of a communication-start request 

from an AV-terminal, the video data regeneration 
control device 162 reads coded video data stored 
in the storage device 161 and transmits the data to 
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the AV-terminal 164-1. In this case, a sequence of 
the video data 1 read-out in the order of frame 
numbers from the storage device 161 as shown in 
Figs. 26A and 26B are not subjected to any pro- 
cessing by the transmission frame processing por- 
tion 154 and transmitted through the communica- 
tion channel control portion 155 to the AV-terminal 
164-1 that in turn regenerates a sequence of the 
received video data in the order of their frame 
numbers. 

If two different video data sequences are suc- 
cessively read from the storage device 161 and 
transmitted without any processing to the AV-termi- 
nal 164-1, two image sequences are reproduced at 
the same order of frame numbers (i.e. frame inter- 
val) as those of the data stored in the storage 
device 161, that causes a delay between the last 
frame of the preceding image sequance and the 
top frame of the succeeding image sequance as 
shown in Fig. 11, giving an impression of dis- 
continuity of the reproduced images. To avoid this, 
in the video data regeneration control device 162, 
the screen number rewriting control portion 153 
instructs the transmission frame processing portion 
154 to rewrite screen (frame) numbers of the suc- 
ceeding video data as shown in Fig. 27. 

For instance, the first transmittable video data 
1 (screen images) shown in Fig. 26A without rewrit- 
ing its frame numbers is first transmitted through 
the channel control 155 to the AV-terminal 164-1. 
Next, the video data reading portion 151 reads 
video data 2 shown in Fig. 26B from the storage 
device 161 and the the screen (frame) number 
rewriting control portion 153 instructs the transmis- 
sion frame processing portion 154 to change a 
screen (frame) number "10" into n 7" of the top 
frame which is then transmitted through the chan- 
nel control portion 155 to the AV-terminal 164-1. 
Succeeding frames of the same video data ^are 
subjected to rewriting their numbers "12" into "9", 
"15" into "12" and so on as shown in Fig. 27, 
keeping the same (unchanged) increment in num- 
bers (i.e., at a specified constant frame interval), 
and, then, they are transmitted one by one to the 
AV-terminal 164-1. Frames of another different vid- 
eo data are successively processed by similarly 
rewriting their number and transmitted to the AV- 
terminal. As shown in Fig. 28, this processing re- 
alizes smooth and continuous regeneration of con- 
catenated video data without causing a delay at a 
junction of two different video data. 

As described above, the present invention is 
directed to the provision of an image-information 
regeneration control device including a frame num- 
ber rewriting control portion, which, in case of 
transmitting two or more different groups of coded 
video data from a storage device to an AV-terminal, 
rewrites a top screen (frame) number of succeed- 



ing different video data into a number consistent 
with that of the last frame of preceding different 
video data and rewrites successive frames of the 
same video data into respective numbers having a 
5 constant (not changed) increment for the purpose 
of realizing smooth and continuous reproduction of 
different video data, independent of their stored 
frame numbers, at any AV-terminal. 

Namely, the video data regeneration control 
fo device for reading any coded video data from the 
storage device for further transmission is connect- 
ed through a communication channel with the AV- 
terminal for receiving and decoding the video data 
for reproduction of images. The video data regen- 
rs eration control device includes a frame number 
rewriting control portion which, in case of transmit- 
ting a plurality of different groups of coded video 
data from a storage device to an AV-terminal, in- 
structs a transmission frame processing portion to 
20 rewrite frame numbers of a group of video data in 
succession to a preceding group in such a way that 
a top frame of the subsequent group of video data 
may have a number consistent with that of the last 
frame of the precedent group and the subsequent 
25 frames of the same group may have respective 
new serial numbers keeping a specified (un- 
changed) increment. Thus processed video data 
are then transmitted to the AV-terminal that can 
successively decode the received video data with- 
30 out delay between the end of the preceding video 
data group and the start of the subsequent group. 

Fig. 29 shows a configuration of the center 
control device shown in Fig. 25, which comprises 
an video data storage portion 171, a terminal-capa- 
35 bility control portion 172, a frame (screen) number 
rewriting control portion 173, a transmission frame 
processing portion 174 and a channel control por- 
tion 175. Other portions similar in function with 
those of Fig. 25 are denoted by the same refer- 
40 ence codes. 

The video data storage portion 171 stores 
records of video data encoded according to the 
coding method defined by the ITU-T recomen- 
dation H.261. The terminal-capability control Por- 
45 tion 172 controls decoding capability of each termi- 
nal that receives coded video data and reproduces 
the images on its display screen. The frame num- 
ber rewriting control portion 173 gives an instruc- 
tion to rewrite frame numbers of the coded video 
so data stored in the storage portion 171 before they 
are transmitted to a terminal. The transmission 
frame processing portion 174 reads the video data 
from the storage portion 171, rewrites the video 
frame numbers according to the instruction given 
55 by the frame number rewriting control portion and 
prepare frames for transmission. The channel con- 
trol portion 175 transmits the prepared frames to 
the receiving terminal over the communication 
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channel 163. Fig. 30 shows a correlation between 
screen (frame) numbers and frames of the video 
data that is encoded at an frame interval 1/29.97 
seconds (hereinafter described as 1/30 sec.) ac- 
cording to a coding method defined by the ITU-T 
recomendation H.261 and stored in the video data 
storage portion 171 shown in Fig. 29. The frames 
are given respective consecutive numbers. 

Fig. 31 shows correlation between the frame 
numbers of the coded video data stored in the 
storage portion (Fig. 30) and frame numbers of the 
frames to be transmitted to the terminal that can 
decode video data at a minimum frame interval of 
2/29.97 seconds (hereinafter described as 2/30 
sec). 

An example of communication between the 
center control device 165 and the terminal 164-1 is 
described as follows: 

When the center control device 165 receives a 
communication-start request from the terminal 164- 
1 t it operates the terminal-capability control portion 
172 to check the decoding capability of the termi- 
nal before transmitting thereto the coded video 
data stored in the video data storage portion 171. 
When an frame interval of the stored frames is of 
1/30 sec. and the terminal has sufficient capability 
to decode coded video data frames at minimum 
frame interval of 1/30 sec, the transmission frame 
processing portion 174 reads the coded video data 
from the storage portion 171 in the order of frame 
numbers as shown in Fig. 31 and transfers them, 
without any kind of processing, to the channel 
control portion 175 that successively transmits the 
received frames to the terminal 164-1 over the 
communication channel. The terminal 164-1 de- 
codes the received coded video data at a frame 
interval of 1/30 sec. 

On the other hand, when the terminal 164-1 
has a capability to decode frames at a minimum 
frame interval of 2/30 sec, i. e. it can not decode 
the coded video data stored in the storage portion 
171, the center control device 165 causes the 
frame-number rewriting control portion 173 to give 
the transmission frame processing portion 172 an 
instruction necessary for rewriting frame numbers 
as shown in Fig. 31. In this case, a first transmis- 
sive frame is a frame (1 ) of the stored coded video 
data shown in Fig. 30, which is not subjected to 
rewriting its number and transmitted through the 
channel control portion 175 to the terminal 164-1. 

Next, the frame number rewriting control por- 
tion 173 requests the transmission frame process- 
ing portion 174 to reads a frame (2) shown in Fig. 
30 from the video data storage portion 171 and 
changes the frame number of the frame (2) from 
"1" into "2". The frame is then transmitted through 
the channel control portion 175 to the terminal 164- 
1. A frame (3) is next read from the video data 



storage portion 171, subjected to changing its num- 
ber from "2" into "4" and transmitted to the termi- 
nal. The subsequent frames are successively re- 
newed in their numbers and transmitted to the 
5 terminal. 

In the above-described example, it is supposed 
that the terminal has a capability to decode the 
frames at an frame interval of 2/30 sec corre- 
sponding to that the half number of the frames of 

10 video data stored in the storage portion 171 can be 
decoded within a same time scale. If the terminal 
has a capability to decode frames at a frame 
interval of 3/30 seconds (standard value is 3/29.97), 
the first transmissive frame (1) is read and trans- 

75 mitted without any processing. The frames (2) and 
(3) to be transmitted second and third are sub- 
jected to rewriting their numbers to "3" and "6" 
respectively. Subsequent frames are similarly pro- 
cessed with renewed numbers before transmission 

20 to the terminal. 

Similarly, when terminal can decode frames at 
a minimum frame interval of 4/30 seconds (stan- 
dard value is 4.29.97), the initial frame (1) is read 
and immediately transmitted to the terminal. The 

25 second and third transmissive frame (2) and (3) are 
subjected to rewriting their numbers to "4" and "8" 
respectively. 

As described above, the center control device 
165 according to the present invention is provided 

30 with a frame number rewriting control portion 173 
for rewriting frame numbers of coded video data 
stored in a storage portion 171, which, thereby, is 
capable of rewriting the screen (frame) numbers of 
the coded video data in accordance with the de- 

35 coding capability of the receiving terminal before 
transmitting the video data thereto. 

The center control device 165 wherein coded 
video data is stored and a terminal for decoding 
coded video data to reproduce therefrom video are 

40 connected with each other through a communica- 
tion channel there between. The center control 
device 165 includes a terminal-capability control 
portion 172 for controlling decoding capability of 
the terminal and a frame number rewriting control 

45 portion 173 for instructing a transmission frame 
processing portion 174 for rewriting frame numbers 
according to the decoding capablity of the terminal, 
which, therefore, is capable of preparing frames 
having renewed numbers and being slowly repro- 

so ducible at the terminal, thus realizing a commu- 
nication between the center control device 165 and 
the terminal. 

Fig. 32 is a construction view for explaining an 
example of a multiplexed data transmitting and 

55 receiving portion of the host shown in Fig. 12. In 
Fig. 32, there are shown a receiver portion 89, a 
transmitter portion 105, a channel data demultiplex- 
ing portion 91, an error correcting portion 92 for 
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FEC (forward error correction), a video frame ex- 
tracting portion 93 and a packet assembling portion 
94, a time stamp generating portion 100, a packet 
disassembling portion 101, a data processing por- 
tion 102, a differential delay absorbing portion 103 
and a channel data multiplexing portion 104. 

The channel data demultiplexing portion 91 
separates multiplexed data received through the 
network into respective components. The error cor- 
recting portion 92 corrects transmission error of 
demultiplexed video data, and the video frame ex- 
tracting portion 93 extracts a video frame from the 
error corrected video data. The packet assembling 
portion 94 assembles a packet of the audio/video 
data. The time stamp generating portion 100 gen- 
erates a time stamp by using an octet timing signal 
outputted from the channel data separating portion 
91. The packet disassembling portion 101 demul- 
tiplexes a received packet into audio/video data 
and other information. The data processing portion 
102 make some due processing of audio/video 
data. The differential delay absorbing portion 103 
absorbs a possible differential delay of the pro- 
cessed audio/video signals in their regeneration by 
using attached thereto time stamps. The channel 
data multiplexing portion 104 generates channel 
multiplexed data of audio/video data and other in- 
formation received from the differential delay ab- 
sorbing portion 103. 

Figs. 14A to 14C are illustrative of video data 
A, B and C between modules of the receiver por- 
tion shown in Fig. 32. Fig. 14A corresponds to a 
signal "a" shown in Fig. 32, which is comprised of 
a synchronizing signal for FEC, parity bits, fill bits 
for adjusting an amount of coded data, and an 
information bit. Fig. 14B corresponds to a signal 
"b" shown in Fig. 32, which is corrected for error 
and relieved of redundant data, e.g., fill bits. Fig. 
14C corresponds to a signal "c" shown in Fig. 32, 
which is a video frame extracted by PSC (picture 
start code). 

Fig. 33 shows a structure of a packet to be 
stored, which includes information: a header con- 
taining storing information on multiplexing rate, en- 
coding method and encoding capacity 181; a video 
data length 182, an audio data length 183; the 
number of stored video frames 184; a time stamp 
of video data, data length of a video frame and 
video frame data 185; and a time stamp of audio 
data 186 and audio data 187. 

The operation of the multiplexed data storing 
and regenerating device according to the present 
invention is as follows: 

At data storing, the channel data demultiplex- 
ing portion 91 splits multiplexed data received 
through the network into audio/video data and other 
information and, then, transfers the video data to 
the error correcting portion 92, the audio data to 



the packet assembling portion 94 and octet timing 
information to the time stamp generating portion 
100. The time stamp generating portion 100 gen- 
erates a time stamp per octet and outputs it to both 

5 the video frame extracting portion 93 and the pack- 
et assembling portion 94. The error correcting port 
ion 92 receives video data as a signal in the state 
shown in Fig. 14A, conducts error correction of the 
data and outputs video data as a signal in the state 

w shown in Fig. 14B to the video frame extracting 
portion 93. 

The video frame extracting portion 93 searches 
PSC (picture start code) in the received data and 
outputs data in the state shown in Fig. 14C and a 

75 time stamp corresponding to the time point of 
finding the PSC to the packet assembling portion 
94. The packet assembling portion 94 assembles a 
packet from the received audio/video data and at- 
tached time stamps according to the packet format 

20 shown in Fig. 33, then it writes the header informa- 
tion on multiplexing rate, encoding method and 
coding capacity necessary for regeneration of the 
data and outputs the prepared data to the storage 
device 83. 

25 At data regenerating, the packet disassembling 

portion 101 receives a packet outputted from the 
storage device 83, extracts therefrom header in- 
formation and transfers it to the system control 
portion 81 that in turn instructs the channel data 
30 multiplexing portion 104 to make the operating 
mode at receiving side match with that of sending 
side by using BAS 14 shown in Fig. 2. 

After completion of matching at the channel 
data multiplexing portion 104, the packet disassem- 
35 bling portion 101 disassembles a packet and trans- 
fers audio/video data and attached time stamps to 
the data processing portion 102 that in turn per- 
forms some due operations on the audio/video data 
and outputs the processed audio/video data with 
40 the time stamps to the differential delay absorbing 
portion 103. The differential delay absorbing por- 
tion 103 absorbs a differential delay of the respec- 
tive component data by the attached time stamp 
and outputs the prepared data to the channel data 
45 multiplexing portion 104 that in turn multiplexes the 
audio/video data and other information according to 
the multiplexing format shown in Fig. 2 and sends 
the multiplexed data into the network. 

As this invention may be embodied in several 
50 forms without departing from the spirit of essential 
characteristics thereof, the present embodiment is 
therefore illustrative and not restrictive, since the 
scope of the invention is defined by the appended 
claims rather than by the description preceding 
55 them, and all changes that fall within meets and 
bounds of the claims, or equivalence of such meets 
and bounds are therefore intended to embraced by 
the claims. 
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Claims 

1. An image-information storage regenerating de- 
vice which can collet and store multiplexed 
data of audio/video and other information from 5 
video data communication terminals, and to 
regenerate the stored data through their termi- 
nal, characterized in that multiplexed data 
transmitting and receiving means (82) to re- 
ceive multiplexed data from a terminal (71 ) for to 
multiplexing an input signal, said signal being 

any one or any combination of video, audio 
and other kind of data, for the purpose of 
storing said data at host side, and to transmit 
stored data as regenerated data; and storage 75 
means (83) to store therein multiplexed data 
containing video, audio and other kind of data, 
said data being received by the multiplexed 
data transmitting and receiving means (82), 
and to output therefrom the stored data for 20 
regeneration, whereby the multiplexed data 
transmitting and receiving means (82) sepa- 
rates multiplexed data and the storage means 
(83) stores therein video data by a separate 
video frame or continuous video frames. 2s 

2. An image-information storage regenerating de- 
vice as defined in claim 1 wherein said mul- 
tiplexed data transmitting and receiving means 

(82) is provided with channel data demultiplex- 30 
ing means to separate respective component 
data from an input signal of multiplexed data, 

said data being any one or any combination of 
video, audio and other kind of data; error cor- 
recting means (92) to correct an error of video 35 
data outputted from the channel data demul- 
tiplexing means (91); video frame extracting 
means (93) to extract a video frame from video 
data outputted from the error correcting 
means(92); and packet assembling means (94) 40 
to assemble a packet from video data and 
audio data, said video data outputted from the 
video frame extracting means (93) and said 
audio data outputted from the channel data 
separating means (91); and the storage means 45 

(83) stores therein a assembled packet output- 
ted from the packet assembling means (94) by 
arranging video data therein by a separate 
video frame or continuous video frames. 

50 

3. An image-information storage and regenerating 
device as defined in claim 1 wherein said 
multiplexed data transmitting and receiving 
means (82) is provided with packet disassem- 
bling means (121) to disassemble a packet 55 
outputted from the storage means (83) into 
respective components; fill bit inserting means 
(122) to optionally insert fill bits into video data 



outputted from the packet disassembling 
means (121); error correction frame generating 
means (123) to produce an error correction 
frame of video data outputted from the fill bit 
inserting means (122); and channel data mul- 
tiplexing means (124) to multiplex video data 
outputted from the error correction frame gen- 
erating means (123) together with data output- 
ted from the packet disassembling means 
(121); and the multiplexed data transmitting 
and receiving means (82) can maintain syn- 
chronization of error correction frame of the 
communication terminal for regenerating stored 
video data. 

4. An image-information storage regenerating de- 
vice as defined in claim 1 wherein said mul- 
tiplexed data transmitting and receiving means 
(82) is provided with packet disassembling 
means (131) to disassemble a packet output- 
ted from the storage means (83) into respec- 
tive components; fill bit inserting means (132) 
to insert fill bits into video data outputted from 
the packet disassembling means (131); data 
amount supervising means (135) to supervise 
an information content of video data outputted 
from the packet disassembling means (131) 
and to control the fill bit inserting means (132); 
error correction frame generating means (133) 
to produce an error correction frame of video 
data outputted from the fill bit inserting means 

(132) ; and channel data multiplexing means 
(134) to multiplex video data outputted from 
the error correction frame generating means 

(133) together with data outputted from the 
packet disassembling means (131); and the 
multiplexed data transmitting and receiving 
means (82) can maintain synchronization of 
error correction frame of the communication 
terminal for regenerating stored video data. 

5. An image-information storage regenerating de- 
vice as defined in claim 1 wherein said mul- 
tiplexed data transmitting and receiving means 
(82) is provided with packet disassembling 
means (131) to disassemble a packet output- 
ted from the storage means (83) into respec- 
tive components; transmission speed matching 
means (136) to match transmission rate with 
video data outputted from the packet disas- 
sembling means (131); fill bit inserting means 
(132) to insert fill bits into video data outputted 
from the packet disassembling means (131); 
data amount supervising means (135) to super- 
vise an information content of video data out- 
putted from the packet disassembling means 

(131) and to control the fill bit inserting means 

(132) ; error correction frame generating means 
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(133) to produce a error correction frame of 
video data outputted from the fill bit inserting 
means (132); and channel data multiplexing 
means (134) to multiplex video data outputted 
from the error correction frame generating 
means (1 33) together with data outputted from 
the packet disassembling means (131); and the 
multiplexed data transmitting and receiving 
means (82) can maintain synchronization of 
error correction frameof the communication 
terminal for regenerating stored video data. 

6. An image-information storage regenerating de- 
vice as defined in claim 1, whereby said video 
data decoding means (144) to decode coded 
video data and intra-frame encoding means 
(145) to encode in intra-frame mode video data 
decoded by the video data decoding means 
(144) are further provided so that coded video 
data of initial image to be stored are trans- 
ferred through the video data decoding means 
(144) and the intra-frame video data encoding 
means (145) and stored as intra-frame coded 
video data. 

7. An image-information storage regenerating de- 
vice which can collet and store multiplexed 
data of audio/video and other information from 
video data communication terminals, and to 
regenerate the store data through their termi- 
nal, characterized in that there are provided 
with channel control means (155), screen-num- 
ber rewriting control means (153) to control 
how to rewrite a screen number indicating se- 
quential number of video data when transmit- 
ting the coded video data, transmission frame 
processing means (154) to prepare transmis- 
sive coded video data by rewriting screen 
number of coded video data according to an 
instruction given by the screen-number rewrit- 
ing control means (153). 

8. An image-information storage regenerating de- 
vice as defined in claim 7, characterized in that 
a video data reading means (151) to read 
stored coded video data and screen-image 
reading means (152) to read a screen-image, 
e.g., a menu image to be displayed at terminal 
are further provided so that, in case of trans- 
mitting coded video data from the video data 
reading means (151) in succession to a 
screen-image from the screen-image reading 
means (152) screen-numbers of video data 
frames can be rewritten to be sequential in 
respect to that of the screen-image according 
to an instruction given by the screen-number 
rewriting control means (153) to eliminate a 
discrepancy between the screen-image and 



the video data and, thereby, assure continuous 
transmission of video data. 

9. An image-information storage regenerating de- 
5 vice as defined in claim 7, characterized in that 

terminal-capability control means (172) to dis- 
criminate and control decoding capacity of a 
terminal to which coded video data shall be 
transmitted is further provided to realize that, 
io when a minimum frame interval being possibly 

decoded by the terminal is larger than frame 
interval of stored video data, the screen-num- 
ber rewriting control means (173) effects re- 
writing frame-numbers of the stored coded vid- 
75 eo data to attain interframe spacing which can 

be decoded by the terminal, establishing there- 
by communication with the terminal to slowly 
reproduce video data thereat. 

20 10. An image-information storage regenerating de- 
vice for storing multiplexed data comprising of 
any one or any combination of video, audio 
and other kind of data and regenerating stored 
data from any terminal, characterized in that 

25 there are provided a multiplexed data transmit- 

ting and receiving means (82) to eliminate a 
possible differential delay of data by using a 
time stamp attached thereto when storing mul- 
tiplexed data and storage means to store mul- 

30 tiplexed data, said data comprising of video, 

audio and other kind of data received by the 
multiplexed data transmitting and receiving 
means (82), and to output the stored data 
when regenerating said data. 

35 

11. An image-information storage regenerating de- 
vice as defined in claim 10 wherein said mul- 
tiplexed data transmitting and receiving means 
(82) attacheds a time stamp to each compo- 

40 nent of the multiplexed data to be stored in the 

storage means and, when regenerating the 
multiplexed data, absorbs a differential delay 
between the kinds of data according to the 
attached time stamps so as to eliminate a 

45 differential delay that may occur between dif- 

ferent kinds of component data at regeneration 
of the multiplexed data. 

12. An image-information storage regenerating de- 
50 vice as defined in claim 10, which is provide 

with channel data demultiplexing means (91) to 
split a multiplexed input signal comprising any 
one or any combination of video, audio and 
other kind of data into respective components; 
55 error correcting means (92) to correct an error 

of video data outputted from the channel data 
demaltiplexing means (91); time stamp gen- 
erating means (100) to generate a time stamp 
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according to an octet timing signal outputted 
from the channel data demultiplexing means 
(91); video frame extracting means (93) to ex- 
tract a video frame from video data outputted 
from the error correcting means (92) and to 5 
extract a time stamp of an image from time 
stamp data outputted from the time stamp 
generating means (100); packet assembling 
means (94) to produce a packet by arranging 
video data and a time stamp outputted from io 
the video frame time stamp generating means 
(100); a time stamp outputted from the time 
stamp generating means (100) and audio data 
and a time stamp outputted from the channel 
data demultiplexing means (91); storage 75 
means to store a packet outputted from the 
packet assembling means (94); packet disas- 
sembling means (101) to receive a packet out- 
putted from the storage means and disassem- 
ble it to a pair of each component data and an 20 
attached thereto time stamp; data processing 
means (102) to make some due operation on 
component data outputted from the packet dis- 
assembling means (101); a differential delay 
absorbing means (103) to absorb a differential 25 
delay of different component data according to 
corresponding time stamps outputted from the 
data processing means (102) and channel data 
multiplexing means (104) to multiplex data out- 
putted from the differential delay absorbing 30 
means (103), whereby a differential delay of 
the respective components separated from the 
multiplexed data and subjected each to some 
due processing can be absorbed. 
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FIG.26 A 
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FIG.30 
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FIG.31 
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